- o O 



S^gS Express Mail Label No. EL172582334UW Docket No.: END9 2000 0041 USl 

NEW UTILITY PATENT APPLICATION TRANSMITTAL 

(Large Entity) 

(Only for new nonprovisional applications under 37 CFR 1.53(b) 

Total Pages this Submission: 3 

TO THE ASSISTANT COMMISSIONER FOR PATENTS 

Box Patent Application 
Washington, D.C. 20231 

Transmitted herewith for filing under 35 U.S.C. 111(a) and 37 C.F.R. 1,53 (b) is a 
new utility patent application for an invention entitled: 

SYSTEM AND METHOD FOR MEASURING AND MANAGING PERFORMANCE IN AN INFORMATION 
TECHNOLOGY ORGANIZATION 

and invented by: 

SUZANNE M. JORDAN, PATRICK W. McMAHON, DAVID B. McNEILL, NORA M. PANLILIO-YAP 
If a CONTINUATION APPI*ICATION, check the appropriate box and supply the requisite Information: 

□ Continuation □ Divisional □ Continuation-in-part (CIP) of prior application 
No. : 

Enclosed are: 

Application Elements 

01. H Filing fee as calculated and transmitted as described below 

02. B Specification having 56 pages and including the following: 

a. B Descriptive Title of the Invention 

b. □ Cross References to Related Applications (if applicable) 

c. □ Statement Regarding Federally-sponsored Research/Development (if 
applicable) 

d. □ Reference to Microfiche Appendix (if applicable) 
€. S Backgroxmd of the Invention 

f . B Brief Summary of the Invention 

g. B Brief Description of the Drawings (if drawings filed) 

h. B Detailed Description 

i. B Claim(3) as Classified Below 
j . B Abstract of the Disclosure 

03. B Drawing(s) when necessary as prescribed by 35 USC 113) 

a. □ Formal 

b. H Informal 
Number of sheets: 8 



Page 1 of 3 



Docket No.: END9 2000 0041 USl 



NEW 


UTILITY PATENT APPLICATION TRANSMITTAL 




{Large Entity) 


(Only for 


new nonprovis zonal applications under 37 CFR 1,53 (b) 




Total Pages this Submission: 3 


Application Elements (Continued) 



04. H Oath or Declaration 

a. □ Newly executed (original or copy) H Not executed 

b. □ Copy from a prior application (37 CFR 1.63(d)) (for 

continuation/divisional application only) 

c. H with Power of Attorney □ Without Power of Attorney 

05. □ Incorporation By Reference (usable if box 4b is checked) 

The entire disclosure of the prior application^ from which a copy of 
the oath or declaration is supplied under Item 4b, is considered as 
being part of the disclosure of accompanying application and is hereby 
incorporated by reference therein. 

06. □ Computer Program in Microfiche (Appendix) 

07. □ Nucleotide and/or Amino Acid Sequence Submission (if applicable ^ all must be 

included) 

a. □ Paper Copy 

b. □ Computer Readable Copy (identical to computer copy) 

c. □ statement Verifying Identical Paper and Computer Readable Copy 

Accoicpanying Application Parts 

08. □ Assignment Papers (cover sheet & document (s) ) 

09. □ 37 CFR 3.73(B) Statement (vjhen there is an assignee) 

10. □ English Translation Document (if applicable) 

11. B Information Disclosure Statement/PTO~1449 H Copies of IDS citation 

12. □ Preliminary Amendment 

13. H Acknowledgment postcard 

14. B Certificate of Hailing 

□ First Class B Express Mail (Label No: EL172582334US) 

15. □ Certified Copy of Priority Document (s) (if foreign priority is claimed) 



Page 2 of 3 



Docket No.: END9 2000 0041 USl 



NEW 


UTILITY PATENT APPLICATION TRANSMITTAL 




(Large Entity) 


(Only for 


new nonprovisional applications under 37 CFR 1,53 (b) 




Total Pages this Submission: 3 



Accompanying J^plication Parts (Continued) 



16. □ Additional Enclosures (identify below) 



For 

Total Claims 
Indep. Claims 



# Filed 
28 

18 



Fee Calculation and Transmittal 
CLAIMS AS FIIiED 
# Allowed # Extra Rate 



Multiple Dependent Claims 



Other FEE (Specify purpose) 



-20 
- 3 



8 
15 



X $18,00 
X $78.00 



BASIC FEE 



TOTAL FILING FEE 



Fee 

$ 144.00 

$1,170.00 

$ 

$ 690.00 
$ 

$2,004.00 



□ 



A check in the amount of $ 



to cover the filing fee is enclosed. 



The Comraissioner is hereby authorized to charge and credit IBM Corporation 
Deposit Account No. 09-0457 as described below. A duplicate copy of this 
sheet is enclosed. 

B Charge the amount of $2,004 as filing fee. 

H Credit any overpayment. 

B Charge any additional filing fees as required under 37 C.F.R. 1.16 and 

1,17. 

□ Charge the issue fee set in 37 C.F.R. 1.18 at the mailing of the Notice 

of Allowance, pursuant to 37 C.F.R. 1.311(b). 



Dated: 





Signature 



Shelley M Beckstrand 
Reg. No. 24,886 

314 Main Street 
Owego, NY 13827-1616 
Phone: (607) 687-9913 



transmitnew.wpd 



Page 3 of 3 



Docket N0.END9 2000 0041 USl 



IN THE UNITED STATES PATENT AND TRADEMARK OFFICE 

In re application of: S . M. JORDAN, ET AL 

Serial No.: N/A Group No.: N/A 

Filed; HEREWITH Examiner; N/A 

For: SYSTEM AND METHOD FOR MEASURING AND MANAGING PERFORMANCE IN AN 
INFORMATION TECHNOLOGY ORGANIZATION 

Assistant Commissioner For Patents 
Washington, D C. 20231 

EXPRESS MAIL CERTIFICATE 

"Express Mail" label number: EL172582334US 

Date of Deposit: 3 /\LL^ J-Ooo 

I hereby certify lhat the following attached paper or fee 

New Utility Patait Apphcation Transmittal 
Specification: 56 pages (including claims) 
Declaration and Power of Attorney (not signed) 
Drawings (8 sheets) 
Ejq)ress Mail Certificate 
Information Disclosure Statement 
PTO Form 1449 (revised) 
Postcard 

is being d^osited widi the United States Postal Service "Express Mail Post Office to Addressee" service 
under 37 CFR 1 , 10 on the date indicated above and is addressed to the US PATENT & TRADEMARK 
OFFICE, COMMISSIONER OF PATENTS, WASHINGTON DC 20231-9998. 



JUDITH A. BECKSTRAND 

(Name of person mailing paper or fee) 

0i^ature of person mailing paper or fee) 

NOTE: Each must have its own c^tficate and the ''Express Mail " label numb^ as a part thereof or attathed therrto. When, as here, the 

ceitificatiai is presented on a separate she^ that she^ must ( 1) be sigaed and (2) fiilly identify and be securely attadied to the p^er or fee 
it acconq)anies. Idoitificatiati should kdude the serial number said filing date of the application as well as the type of paper being filed, 
e.g., conq)!^ ^hcatim, specification and drawings, res^xmses to rejecUon or refiisal, notice of appeal, d:c. If the s^ial number of the 
^plication is n<t known, the ideiitificatitm should include at least the name of the inv«itor(s) and the title of the invention, 

NOTE; The label number need not be placed on each page. It should, however, be placed on the first page of eadi sq)arate document, such as, a 
new application, amoidmoit, assipiment, and transmittal letter fw a fee, along with the certificate of mailing by "Express Mail". 
Althou^ the label number may be on checks, sudi a practice is not required. In order n<A to deface formal drawings, it is suggested that 
the label number be placed m the bade of each formal drawing or the (fcawings be accorr5)anied by a sd. of informal drawings on which the 
label number is placed 



APPLICATION 



FOR 



UNITED STATES LETTERS PATENT 



APPLICANT NAME S. M. JORDAN, ET AL. 



INTERNATIONAL BUSINESS MACHINES CORPORATION 



CERTIFICATE OF MAILING UNDER 37 CFR 1.10 

I hereby certify that, on the date shown bdovsr, this correspoadence is being 
deposited with the United States Postal Service in an axvelope addressed to 
the Assistant Commissionar for Patents, Washington, D.C., 2023 1 as 

"Express Mail Post OfBceto Addressee" on c3. AlCf 9-000 

mUmg Label No. CL l'7X iSi. S3f U '■ 
Name of pascm mailing piq)er: ^ooiTti^ -A. 'i>£<^^STe.fkK!D 



TITLE 



SYSTEM AND METHOD FOR 
MEASURING AND MANAGING 
PERFORMANCE IN AN 



INFORMATION TECHNOLOGY 
ORGANIZATION 



DOCKET NO. 



END9 2000 0041 USl 




Date 



SYSTEM AND METHOD FOR MEASURING AND MANAGING PERFORMANCE IN 
AN INFORMATION TECHNOLOGY ORGNIZATION 



Background of the Invention 

Technical Field of the Invention 

This invention pertains performance management. More 
particularly, it relates to measuring and managing the 
performance of an information technology (IT) organization. 

Background Art 

Developing a system that measures the performance of an 
IT organization is critical to managing the IT organization 
and continually improving the processes that it employs over 
time. However, no regular, canonical method for developing 
a system that measures the performance of an IT organization 
is evident in the industry. The lack of such a method 
creates great difficulty in understanding the performance of 
the IT organization, and this is a critical aspect to 
successful management and improvement of the IT organization 
over time. This problem has existed since the formation of 
IT organizations* Consequently, there is a need in the art 
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for a repeatable work product-based method for defining and 
implementing a measurement program for an IT organization. 

There is a need in the art for a system and method for 
providing measurement gap analysis describing the 
relationship between the measurement system and the 
underlying organization and processes- Without appropriate 
organizational and process support^ it is difficult for any 
measurement system to achieve maxim-urn potential usefulness. 
Measurement systems that are supported by the appropriate 
organizational structure and are fully integrated with the 
organizations process have a much higher probability of 
being effective. 

It is an object of the invention to provide a system 
and method for systematically defining and implementing a 
measurement program. 

It is a further object of the invention to provide a 
system and method for implementing a measurement program 
that is supported by an appropriate organizational structure 
and that is fully integrated with the organization's 
processes. 



It is a further object of the invention to provide a 
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system and method for identifying and defining measurements 
necessary to support the management of an IT organization. 

It is a further object of the invention to provide a 
system and method for linking defined measurements to 
organization goals and objectives. 

It is a further object of the invention to provide a 
system and method of integrating measurement ownership into 
an organizational model. 

It is a further object of the invention to provide a 
system and method for integrating measurement data 
collection into an IT process model. 

It is a further object of the invention to provide a 
system and method for developing a technical environment for 
supporting measurement data collection, analysis and 
reporting. 

It is a further object of the invention to provide a 
system and method for developing the technical interfaces 
necessary to support measurement data collection. 



It is a further object of the invention to provide a 
END9 2000 0041 USl 3 



system and method for developing measurement reporting 
methods . 

It is a further object of the invention to provide a 
system and method for developing training and end-user 
support materials for a measurement system. 



Summary of the Invention 



A system and method for defining and implementing 
measurements to support a customer information technology 
organization. Steps involve identifying customer 
performance goals; building a model in response to customer 
goals including a plurality of primitive metrics; performing 
a gap analysis of the model to determine which of the 
primitive metrics are already collected by the organization 
and the process capabilities to support the data collection; 
identifying new data collection sources for the primitive 
metrics which are not already collected by the organization; 
and implementing the tools and processes for gathering all 
of the primitive metrics and tools for generating 
measurement reports from the gathered primitive metrics. 
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In accordance with a preferred embodiment of the 
invention^ measures of performance of a customer information 
technology organization are determined by defining the 
organization goals, identifying the behaviors that the 
organization exhibits when working toward or meeting the 
defined goals, identifying and defining the measurements 
that provide empirical evidence on the achievement and 
attainment of the desired behaviors, balancing the defined 
measurement categories, and prioritizing the measurements 
for implementation based on the balance. 

Other features and advantages of this invention will 
become apparent from the following detailed description of 
the presently preferred embodiment of the invention, taken 
in conjunction with the accompanying drawings. 

Brief Description of the Drawings 

Figure 1 is high level flow diagram illustrating the 
context of the method of a preferred embodiment of the 
invention. 

Figure 2 is a high-level overview of the measurement 
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and performance management (MAPM) method of a preferred 
embodiment of the invention. 

Figure 3 is a diagram detailing the high-level overview 
of the MAPM method of Figure 2 from a work product-based 
5 view. 

Figure 4 is a diagram illustrating the measurement gap 
analysis embodiment of the invention. 

Figure 5 is a diagram illustrating a measurement model 
for an IT organization including the notion of behaviors in 
10 accordance with a preferred embodiment of the invention. 



Best Mode for Carrying Out the Invention 

Referring to Figure If the process of the preferred 
embodiment of the invention for creating a measurement model 
work product 102 is part of the requirements phase of the 
15 measurement and performance management (MAPM) methodology. 

This process relies on input from a target future business 
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capabilities work product 101 and provides critical input 
into the measurement gap analysis work product 103. 
Measurement model 102 represents the core of requirements 
for the MAPM method and is used as the basis for developing 
process and organizational linkages, and many other 
technical work products to support its implementation with 
an information technology (IT) organization. A more 
detailed description of the process for creating measurement 
model work product 102 will be provided hereafter, 
particularly in connection with Figure 6. 

Referring to Figure 2, a high level view of the method 
of a preferred embodiment of the invention includes in step 
200 collecting into a competency-defined measurement 
categories and measurements file definitions of human 
resources 210, quality 211, customer 212, cost and schedule 
213, process 214, and productivity and output 215 
measurement parameters. In step 202, a measurement adoption 
method is executed, thereby selecting and defining contract 
measurements. In step 204, a measurement architecture and 
implementation method is executed to implement the contract 
measurements. In step 206, a measurement operations 
services method is executed to implement ongoing use and 
maintenance of measurements. As is represented by step 208, 
measurement program work products are produced and used 
END9 2000 0041 USl 7 



throughout steps 200-206. 



Referring to Figure 3^ the system and method of the 
preferred embodiments of the invention are built upon the 
IBM Work Product-based Methodology Development Approach as 
defined and implemented by Solution Consulting Integration 
(SCI) practice through its SCI Enablement Process and new 
work products which extend the SCI method • These new work 
products include three work products representing the 
formulation of the measurement requirements that are to be 
implemented in an engagement, and are illustrated in Figure 
3 as measurement model 102, current customer measurements 
242, and measurement gap analysis 103 • These new work 
products also include four work products representing 
additional implementation and/or technical requirements to 
support the implementation of measurement model 102, and 
include interface agreement 268, configuration script 272, 
contract measurement business policy 276, and scorecard 270. 

Practitioner accesses to the documents that are the 
work products of the preferred embodiment of the method of 
the invention may be, for example, by way of HTML code that 
provides users of the method access to work product (WP) 
dependency diagrams, engagement models, work product 
description papers and work product technique papers. 
END9 2000 0041 USl 8 



Similarly^ such documents may be maintained in collaboration 
space, and available based on access controls, to members of 
development, marketing and implementation teams throughout 
an enterprise « The IBM QuickPlace (TM) provides such a 
5 collaboration space. The Lotus Domino/Notes (TM) may also 

be used to control access using access control lists and 
provide consistency among several instances of data using 
replication. 

An MAPM engagement includes three contextual phases 
10 220, 222, and 224, Proposal phase 220, in the context of 

developing a measurement solution, represents the 
development of the initial solution specifications, 
including costs, that are to be delivered to a customer. 
Due diligence phase 222 represents the validation of 
15 assumptions and expectations that are made in developing a 
proposal to the customer before an outsourcing agreement is 
signed. Transition/transformation phase 224 represents the 
first major group of activities that occur once a legal 
contract for outsourcing has been established. This is 
20 where the transfer of resources and assets occurs and the 
implementation of specific new processes and procedures is 
introduced into this new organization. 

Proposal phase 220 includes the following work 
END9 2000 0041 USl 9 



products: current customer measurements 242, target future 
business capabilities 101, future process design points 248, 
to-be organization design 250, measurement model 102, 
recommendation and preliminary business case 240, and 
current IT infrastructure 230. Other work products 
providing input to proposal phase 220 include measurement 
catalog 234 and business policy 236 • 

Due diligence phase 222 includes the following work 
products: measurement gap analysis 103, to-be process design 
252, measurement model 102, interface agreement 268, model 
of network workstation technical architecture 260, current 
application portfolio 264, and model of technical server 
architecture 2 62« 

Transition/transformation phase 222 includes the 
following work products: interface agreement 2 68, deployment 
plan 274, external interface requirements 266, configuration 
script 272, end-user training materials 278, contract 
measurement business policy 276, and scorecard 270. 

As is represented by line 401, current IT 
infrastructure work product 230 provides input to model of 
network workstation technical architecture work product 260. 
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As is represented by line 402^ measurement model work 
product 102 provides input to architecture work product 2 60, 

As is represented by line 403, technical architecture 
work product 260 provides input to model of technical server 
architecture 262, 

As are represented by lines 404, 405, and 406, inputs 
to measurement gap analysis work product 103 come from to-be 
organization design work product 250, future process design 
points work product 248, and current customer requirements 
work product 242, respectively, with feedback to to-be 
organization design work product 250 from measurement gap 
analysis work product 103, 

As is represented by line 407, measurement model work 
product 102 provides input to recommendation and preliminary 
business case work product 240, 

As is represented by line 408, measurement gap analysis 
103 and measurement mode 102 feed each other. 

As is represented by line 409, target future business 
capabilities work product 101 provides input to measurement 
model 102, as further described above in connection with 
END9 2000 0041 USl 11 



Figure 2, 



As is represented by lines 410, 411, 412 and 415, 
measurement model work product 102 provides inputs to model 
of technical server architecture work product 262, current 
application portfolio work product 264, configuration script 
work product 272 and interface agreement work product 268, 
respectively. 

As is represented by lines 413 and 414, measurement 
model work product 102 receives inputs from measurement 
catalog work product 234 and business policy work product 
236, respectively. 

As is represented by lines 417 and 423, current 
application portfolio work product 264 provides inputs to 
interface agreement work product 268 and contract 
measurement business policy work product 276. 

As is represented by lines 418 and 424, interface 
agreement work product 268 provides inputs to configuration 
script work product 272 and scorecard 270, respectively. 

As is represented by line 419, external interface 
requirements work product 266 provides input to interface 
END9 2000 0041 USl 12 



agreement 268. 



As is represented by lines 420 and 427, configuration 
script 272 provides inputs to scorecard 270 and contract 
measurement business policy work product 276, respectively- 

As is represented by line 421, model of technical 
server architecture work product 2 62 provides input to 
deployment plan work product 274. 

As is represented by line 422, end-user training 
materials work product 278 provides input to deployment plan 
work product 274. 

As is represented by line 425, contract measurement 
business policy work product 27 6 provides input to end-user 
training materials work product 278. 

As is represented by lines 426 and 428, model of 
network workstation technical architecture work product 260 
provides inputs to contract measurement business policy work 
product 276 and deployment plan work product 274, 
respectively t 



As is represented by line 429, scorecard work product 
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270 provides input to end-user training materials 278. 

As is represented by line 430/ measurement gap analysis 
work product 103 and to-be process design work product 252 
exchange inputs and outputs. 

5 Current IT infrastructure 230 describes the physical 

systems and network configurations of the customer. 

Target future business capabilities 101 defines the 
customer's goals and objectives, necessary to achieve 
through measurements. 

10 Measurement catalog 234 is the intellectual capital 

that contains the results of all previous engagements, and 
is used to support new engagements in the selection of 
measurements . 

Business policy 236 represents optional intellectual 
15 capital describing business policies. 

Measurement model 102 defines the key requirements for 
the engagement, represents the translation of target future 
business capabilities 101 into account specific behaviors, 
and includes measures that empirically demonstrate those 
END9 2000 0041 USl 14 



behaviors. The process implemented by measurement model 102 
will be further described hereafter in connection with 
Figures 5 and 6. 

Recommendation and preliminary business case 240 
defines high level cost benefit estimates on the technical 
solutions that might be considered for measurement model 
implementation . 

Current customer measurements 242 provides a detailed 
list of the measurements that are being collected and 
reported currently by the customer. 

Future process design points 248 provides high level 
requirements for developing the to-be process design 252. 

To-be organization design 250 is the planned 
organization model. 

To-be process design is 252 is the planned processes 
model . 

Model of network/workstation technical architecture 260 
is a systems view of the hardware and software that supports 
the end users of the measurement system. 
END9 2000 0041 USl 15 



Model of technical server architecture 262 is a systems 
view of the hardware and software server that supports the 
measurement system implementation and the system' s end 
users . 

Current application portfolio 254 is a detailed list of 
the applications that are being supported by the 
vendor/ service organization. 

External interface requirements 266 is a detailed list 
of the outside systems that the measurement system must 
interface in order to perform data collection or data 
extraction* 

Interface agreement 268 is a formal agreement between 
systems to ensure that expectations for data collection are 
appropriately documented. 

Scorecard 270 is the visualization (reporting) 
requirements of the measurement system. 

Configuration script 272 is the code necessary to 
configure the tools used to implement the measurement model. 

Deployment plan 274 is the project plan for 
END9 2000 0041 USl 16 



implementing the system in the organization. 

Contract measurement business policy 276 provides the 
basic expectations of behavior on the account that must be 
conformed to in order to support data collection, reporting 
and analysis for the measurement system. 

End user training materials 278 are educational 
materials used to teach the organization about the 
measurement system and its supporting tools. 

Developing a system that measures the performance of an 
IT organization is critical to managing the IT organization 
and continually improving the processes that it employs over 
time. In accordance with a preferred embodiment of the 
invention, an IT measurement system is aligned with the IT 
organization's business goals by examining the IT 
organization's current state-of-af fairs with respect to 
measurement and analyzing how it maps to a proposed 
measurement model. To ensure the viability of the proposed 
measurement model, it is important the IT organization be 
structure to support the model and that the processes 
employed within the organization lend themselves to 
naturally support the collection, analysis, reporting, and 
use of the measurements in the proposed model. In 
END9 2000 0041 USl 17 



accordance with a preferred embodiment of the invention, a 
method is provided for systematically analyzing how the IT 
organization's current measurement system, if one exists, 
maps to the proposed measurement model and for identifying 
impacts to the to-be organization design and the to-be 
process design. 

Measurement gap analysis 103 defines the difference 
between the measurement model 102 and current customer 
measurements 242, additionally, with reference to to-be 
organization design 250 and to-be process design 252, 
considering possible deficiencies in the organization model 
and organization processes. 

Heretofore organizations in industry, while recognizing 
the need for establishing or improving measurement systems, 
have done so through a project-level perspective • In 
accordance with the system and method of the preferred 
embodiment of the invention, measurement gaps are addressed 
at the contract or program level. The gaps which are 
identified include gaps in the measures to be collected, 
analyzed, reported, and used, together with the critical 
relationship of measurements to the underlying organization 
structure and the processes that the organization employs. 
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Referring to Figure 4, a flow diagram of the 
measurement gap method of a preferred embodiment of the 
invention illustrates the inputs and outputs and the steps 
executed in developing measurement gap analysis work product 
103. 

In step 302, current customer measurements 242 are 
reviewed. 

In step 304, current customer measurements 242 are 
mapped to measurement model 102. 

In step 306, measurement gaps are identified. 

In step 308, measurements not covered by the 
measurement model are identified. 

In step 310, non-productive measurements are 
identified. 

In step 312, the impact to the existing organizational 
structure is identified. 

In step 314, the impact to processes is identified. 
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In step 316^ other requirements for measurement program 
success are identified. 

The canonical method of the preferred embodiment of the 
invention for developing a system that measures the 
performance of an IT organization involves identifying 
measures for an IT organization that are directly tied to 
goals and behaviors that the IT organization should be 
exuding, as defined by the IT management team. ^'Canonical" 
means fully thought through and consistent. The measurement 
model work product 102 and associated techniques work from a 
top-down approach, starting with the goals of the 
organization, identifying appropriate behaviors and finally 
associating measures that will empirically demonstrate 
achievement of the behaviors. In addition, algorithms for 
prioritization are executed to ensure that the best fitting 
measures are selected in the final measurement model. 

Referring to Figure 5, this canonical process for 
defining measurements model work product 102 includes in 
step 232 articulating the envisioned to-be business goals 
through a series of goals and questions or behaviors. In 
step 236, in an optional, more specific embodiment, standard 
business policy driving behaviors that are assumed or 
expected are defined. In step 234, a measurements catalog 
END9 2000 0041 USl 20 



of industry measurements are enumerated and fully defined in 
a database of existing contract measurements, including 
behaviors and goals that they satisfy. 

In step 326, an intellectual mapping is done between 
the envisioned to-be business goals and potential measures, 
A prioritization and balancing process is applied to ensure 
that the best measures are selected* This step 326 involves 
a two step prioritization and balancing process including, 
in step 328, prioritization of measures by number of 
objectives and behaviors satisfied, and in step 330 
identification of measures that have the highest number of 
occurring related measures in the same or another category. 

The method of the preferred embodiment of the invention 
draws upon several concepts from goals-question-metric (GQM) 
techniques described in Basili, Victor et al . , "'The Goal 
Question Metric Approach," Institute for Advanced Computer 
Studies, Department of Computer Science, University of 
Maryland, College Park, Maryland, To this are added notions 
of behaviors as a bridge between organizational goals and 
the identification and definition of measures that enable 
the required behaviors attempting to occur. The inclusion 
of behaviors in the overall technique implemented by the 
preferred embodiment of the invention creates a more tightly 
END9 2000 0041 USl 21 



integrated measurement model especially when dealing with 
measurement definition at the IT organization level, where 
business drivers and other organizational objectives form 
the basis of measurement requirements. Behaviors are the 
performance expectations of the individuals affected by the 
measurement model. These could be new ways of acting or new 
areas of focus in the respective roles on the account. 

Referring to Figure 6, a more detailed description of 
this canonical process includes, in step 340, defining the 
IT organization goals; in step 341, defining associated 
behaviors; in step 342, mapping behaviors against the 
measurement catalog; in step 343, building a first draft 
measurement model; in step 344 prioritizing measures by 
number of behaviors satisfied; in step 345, prioritizing 
measures on number of related measures; in step 346 building 
a second draft measurement model; and in step 347 performing 
gap analysis. Each of these steps will be further 
described. 

In step 340, IT organization goals are identified 
during the creation of target future business capabilities 
work product 101. Typically, the goals of the organization 
are broken out into one or more categories of measures. In 
accordance with the preferred embodiment of the invention, 
END9 2000 0041 USl 22 



these six categories include those previously discussed in 
connection with Figure 2, and are human resources 210 
quality 211, customer 212, cost and schedule 213, process 
214, and productivity and output 215. 

In step 341, behaviors that best demonstrate 
achievement of a particular organizational goal are defined. 
For each of the organization goals defined in target future 
business capabilities work product 101, one or more 
behaviors are defined. Similar in concept to the question 
aspects of the GQM approach, behaviors are defined to 
represent those characteristics the IT organization should 
foster as part of its normal operations. Behaviors identify 
an end state that should be directly tied to the 
organizations goals. 

As an example, if the organization's goal is in the 
area of ensuring that appropriate processes exist in the IT 
department, several behaviors might be identified, such as 
(1) the ability of the organization to forecast process 
needs, that is processes that should exist today but do 
not); (2) the knowledge of the IT staff of existing 
processes; (3) the ability to manage to process gaps; and 
(4) the consistent use and adherence to documented 
processes . 
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Behaviors are typically simple sentence structures and 
may even be incomplete sentences. They are short statements 
that represent ideas r actions or activities that demonstrate 
commitment and refinement of the organization goals. 
Typically, the organization goals are expressed as high 
level statements or highly summarized notions. Behaviors 
are intended to be a level or two below the organization 
goals and bring about a level of granularity low enough to 
support identification of measures that might empirically 
demonstrate achievement of the desired behaviors. 

A sample table for capturing the results of this step 



341 is included 


in Table 1: Goals, 


Behaviors, and 


Measurements : 






TABLE 1: 


GOALS, BEHAVIORS 


, AND MEASUREMENTS 


Goal 1 


Behavior 1 


Measurement 1 


Goal 2 


Behavior 2 


Measurement 2 



where measurements are those identified in step 342, infra. 

In step 342, those measurements from the measurement 
catalog 234 that best satisfy the identified behaviors are 
identified. This catalog is a database accessed using 
associated behaviors as a search parameter. 
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In step 343, the first draft 326 of measurement model 
102 is built. This involves documenting the results of step 
342 in the measurements column of Table 1 and in 
measurements model 326. In addition, other attributes of 
the measures are captured in measurement model 32 6, with 
their base values coming from measurement catalog 234. 
Table 2 illustrates the fields in measurements model 326 for 
capturing measurements and other attributes. 
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TABLE 


2: MEASUREMENTS MODEL FORMAT 


FIELD NAME 


DESCRIPTION 


MEASUREMENT NAME 


NAME OF THE MEASURE 


MTTTi QTTPPMTPMT 
iYLiiirlo Ui^Jlil-lI-jiN 1 




DEFINITION 


ITS DEFINITION 


1?T TrMTTTvTTTiT MTTTPTPC! 
iiiLiJljiYllljiN iiiij iyiilj 1 Kli^ O 


KTWaT TC; THF VT.FMFNTAT. DATA 'RF.nTTTRF.n TO 




CALCULATE THE MEASURE? 


M"l?2i CJTTPirMTrKrT 
iYiilii\0 UrV-JLlXLjliiN 1 




CALCULATION 


HOW IS THE MEASURE CALCULATED? 


PFT.ATirri 


WHAT RELATED MEASURES EXIST FOR THIS 


vriTTv CTTDiT'Nyrir'Nn^c 
JMliltAoUKlijjyLjLJN i o 




FREQUENCY OF DATA 


HOW OFTEN IS DATA FOR THIS MEASURE 




POT T Trr"T'TP"n9 


FREQUENCY OF 




ML Ao U KiiiiXLiljiM i 


rlUvV Ur iiiiiN rxKib ixirj ixiijouiJiO \Ji: inxo 


REPORTING 


MEASURE REPORTED? 


KtrOKiiJMb fKUL-tiOO 






DATA? 


EVENT TRIGGER 


WHAT EVENT OR STEP IN THE PROCESS 




TRIGGERS THE AVAILABILITY OF THIS DATA 


ORGANIZATIONAL 




OWNER 


NAME OF ORGANIZATIONAL OWNER 



In step 344, a first prioritization exercise 328 is 
performed on the measures in the first draft 32 6 of 
measurement model 102. For each of the measures identified 
in step 342, a table is built that describes the 
relationship with each of the behaviors it may satisfy- In 
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many cases^ a single measure may actually satisfy more than 
one behavior. This is important in the identification and 
selection of measures^ since it is most desirable to keep 
the final number of measurers to a minimum. This 
prioritization process is done for each of the categories of 
the measurement model 102. Table 3^ First Prioritization 
Example: People Measurements, illustrates how to capture the 
prioritization in this step 344. 
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TABLE 3: FIRST PRIORITIZATION EXAMPLE: PEOPLE MEASUREMENTS 

PART A 



BEHAVI ORS /MEASUREMENT S 



PEOPLE BEHAVIORS 



JOB 
SATIS- 
FACTION 



TURNOVER 
RATE 



REASONS 
FOR EXIT 



CERTI- 
FICATION 
PROGRAM 
EFFECTIVE- 
NESS 



FORECAST SKILLS NEED ON 
A ROLLING X MONTH BASIS 



X 



KNOW/MONITOR THE 
CURRENT SKILLS 



X 



MANAGE TO THE SKILLS 
GAP 



ACTIVELY MANAGE 
ENVIRONMENTAL ISSUES 



X 



X 



PLAN AND MANAGE TO 
SHORT-TERM AND LONG-TERM 
USAGE OF CONTRACTORS 

MANAGE TO THE REDUCTION 
OF LONG-TERM CONTRACTOR 
DEPENDENCIES 

RECRUIT ENTRY LEVEL 
STAFF TO MEET A PORTION 
OF FUTURE SKILLS NEED 

HIRE EXPERIENCED PEOPLE 
TO FILL IMMEDIATE SKILL 
NEEDS, WHICH ARE LONG- 
TERM IN NATURE 

PROACTIVELY MANAGE 
RECRUITMENT UNTIL NEW 
HIRES ARE ON-BOARD 

PROACTIVELY FOSTER LONG- 
TERM RELATIONSHIPS WITH 
LOCAL RECRUITMENT 
SOURCES 

CREATE AN ENVIRONMENT 
ATTRACTIVE TO TARGETED 
RECRUITS X 

MSASUBEMEIirK^ SUBTOTAL 2 2 
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TABLE 3: FIRST PRIORITIZATION EXAMPLE: PEOPLE MEASUREMENTS 
PART B ^ 

BEHAVIORS /MEASUREMENTS ^ ~ 



PEOPLE BEHAVIORS CONTRACTOR CONTRACTOR UNFILLED JOB OFFER 

ENGAGEMENT USAGE POSITIONS ACCEPTANCE 

DURATION RATE 



FORECAST SKILLS NEED ON 
A ROLLING X MONTH BASIS 

KNOW/MONITOR THE 

CURRENT SKILLS XXX 
MANAGE TO THE SKILLS 

GAP XX 

ACTIVELY MANAGE 
ENVIRONMENTAL ISSUES 

PLAN AND MANAGE TO 
SHORT-TERM AND LONG-TERM 

USAGE OF CONTRACTORS X X 



MANAGE TO THE REDUCTION 
OF LONG-TERM CONTRACTOR 
DEPENDENCIES 

RECRUIT ENTRY LEVEL 
STAFF TO MEET A PORTION 
OF FUTURE SKILLS NEED 

HIRE EXPERIENCED PEOPLE 
TO FILL IMMEDIATE SKILL 
NEEDS, WHICH ARE LONG- 
TERM IN NATURE 



X X 



X 



X X 



PROACTIVELY MANAGE 
RECRUITMENT UNTIL NEW 
HIRES ARE ON-BOARD 

PROACTIVELY FOSTER LONG- 
TERM RELATIONSHIPS WITH 
LOCAL RECRUITMENT 
SOURCES 

CREATE AN ENVIRONMENT 
ATTRACTIVE TO TARGETED 
RECRUITS 

MEASUBEMEN7 SUBTOTAL 4 4 4 
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The measurement subtotal scores in Table 3 are derived 
from simple counts of the numbers of X' s in each of the 
columns. Those measures with the highest scores satisfy the 
most number of behaviors and are more desirable as measurers 
5 in the model since they provide more knowledge and insight 
for the cost of implementation. Of course, the table could 
be modified to reflect weighting factors on both cost and 
effectiveness, but such is not deemed essential for this 
embodiment of the invention, 

10 In step 345, the second prioritization process 330 is 

performed on the measurements in the first draft 326 of 
measurement model 102. For each of the measures identified 
in step 342, a table is built that describes the related 
measure. In many cases a single measure may actually be 

15 related to more than one measure. This is important in the 
identification and selection of measures, since it is most 
desirable to keep the final number of measures to a minimum. 
This prioritization process 330 is done for each of the 
categories of the measurement model. Table 4, Second 

20 Prioritization Example: People Measurements, illustrates how 
to capture the prioritization in this step 345, 
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TABLE 4: SECOND PRIORITIZATION EXAMPLE: PEOPLE MEASUREMENTS 

PART A 



PEOPLE MEASUREMENTS 



JOB 

SATIS- 
FACTION 



JOB SATISFACTION 0 
TURNOVER RATE 

REASONS FOR EXIT X 

CERTIFICATION 
PROGRAM 

EFFECTIVENESS X 
CONTRACTOR 

ENGAGEMENT DURATION X 

CONTRACTOR USAGE X 

UNFILLED POSITIONS X 

JOB OFFER 
ACCEPTANCE RATE 

MEASUREMENT SUBTOTAL 5 



PEOPLE MEASUREMENTS 



TURNOVER 
RATE 



REASONS 
FOR EXIT 



X 
0 



X 



X 
X 
0 



CERTI- 
FICATION 
PROGRAM 
EFFECTIVE- 
NESS 



X 
X 



X 
3 



END9 2000 0041 USl 



31 



TABLE 4: SECOND PRIORITIZATION EXAMPLE: PEOPLE MEASUREMENTS 
PART B 

PEOPLE MEASUREMENTS 



PEOPLE MEASUREMENTS CONTRACTOR CONTRACTOR UNFILLED JOB OFFER 

ENGAGEMENT USAGE POSITIONS ACCEPTANCE 

DURATION RATE 



JOB SATISFACTION X 

TURNOVER RATE X X 

REASONS FOR EXIT 

CERTIFICATION 

PROGRAM 

EFFECTIVENESS 

CONTRACTOR 

ENGAGEMENT DURATION 0 X 



CONTRACTOR USAGE 0 X X 

UNFILLED POSITIONS 0 X 
JOB OFFER 

ACCEPTANCE RATE XX 0 

MEASUREMENT SUBTOTAL 2 3 2 2 



The measurement subtotal is derived from the sum of X' s 
in each of the columns. Those measures that have the 
highest scores also have the highest number of related 
measures, making them desirable as measurement for the base 
model. When prioritized against the results of the 
behaviors to measurement matrix (Table 3), an initial set of 
measurements can be identified. The cells with a "0" entry 
indicate the same measure to same measure condition, which 
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should not be considered in the matrix^ because it is not 
meaningful to relate a measure to itself • 

In step 346^ the results of the prioritization 
processes 328 and 330 are used to build the second draft 332 
of measurement model 102. The tables built in steps 344 and 
345 are used to select those measures that should be 
included in the final measurement model. A simple approach 
is to calculate the mean values of measurement subtotals 
from each of Tables 3 and 4 and select those measures that 
have scores greater than or equal to that mean. 

As an example;, in step 344, the mean score is 

[ (2+2+2 + 0+4+4+4 + 1) /8] = 2.375 

As a result, the following measures would be selected: 
contractor engagement duration, contractor usage, and 
unfilled positions. Some measures may need to be included 
in measurement model 102 in exception of this prioritization 
process either because of specific customer need or because 
it may be the only measure that satisfies a particular 
behavior and/ or goal. 



The selected measures are then captured in the format 
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described in step 343, Table 2. 

In step 347, once the final set of measures has been 
documented, a gap analysis 103, as previously described in 
connection with Figure 4, needs to be done to ensure that 
linkages are in place between the measurements, processes 
and organization • In addition, any time a change that 
results in the addition or deletion of a measurement in the 
model occurs, the gap analysis step is performed. 



Advantages over the Prior Art 

It is an advantage of the invention that there is 
provided a system and method for systematically defining and 
implementing a measurement program. 

It is a further advantage of the invention that there 
is provided a system and method for implementing a 
measurement program that is supported by an appropriate 
organizational structure and that is fully integrated with 
the organization's processes. 

It is a further advantage of the invention that there 
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is provided a system and method for identifying and defining 
measurements necessary to support the management of an IT 
organization* 

It is a further advantage of the invention that there 
is provided a system and method for linking defined 
measurements to organization goals and objectives* 

It is a further advantage of the invention that there 
is provided a system and method of integrating measurement 
ownership into an organizational model. 

It is a further advantage of the invention that there 
is provided a system and method for integrating measurement 
data collection into an IT process model. 

It is a further advantage of the invention that there 
is provided a system and method for developing a technical 
environment for supporting measurement data collection, 
analysis and reporting. 

It is a further advantage of the invention that there 
is provided a system and method for developing the technical 
interfaces necessary to support measurement data collection. 
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It is a further advantage of the invention that there 
is provided a system and method for developing measurement 
reporting methods. 

It is a further advantage of the invention that there 
5 is provided a system and method for developing training and 

end-user support materials for a measurement system. 



Alternative Embodiments 

It will be appreciated that/ although specific 
embodiments of the invention have been described herein for 

10 purposes of illustration, various modifications may be made 
without departing from the spirit and scope of the 
invention. In particular , it is within the scope of the 
invention to provide a computer program product or program 
element/ or a program storage or memory device such as a 

15 solid or fluid transmission medium/ magnetic or optical 

wire, tape or disc, or the like, for storing signals 
readable by a machine, for controlling the operation of a 
computer according to the method of the invention and/or to 
structure its components in accordance with the system of 

2 0 the invention, 
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Further, each step of the method may be executed on any 
general computer, such as an IBM System 390, AS/400, PC or 
the like and pursuant to one or more, or a part of one or 
5 more, program elements, modules or objects generated from 
any programming language, such as C++, Java, Pl/1, Fortran 
or the like- And still further, each said step, or a file 
or object or the like implementing each said step, may be 
executed by special purpose hardware or a circuit module 
10 designed for that purpose* 

Accordingly, the scope of protection of this invention 
is limited only by the following claims and their 
equivalents . 
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CLAIMS 



We claim: 



1 1. A method for defining the measures of performance of a 

2 customer information technology organization, comprising the 

3 steps of: 

4 identifying customer performance goals; 

5 building a model in response to the customer goals 

6 including a plurality of primitive metrics; 

7 performing gap analysis of the model to determine which 

8 of the primitive metrics are already collected by said 

9 organization and the process capabilities for data 

10 collection; 

11 identifying new data collection sources for those 

12 primitive metrics which are not already collected by 

13 said organization; 

14 implementing tools and processes for gathering said 
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15 



primitive metrics; and 



16 generating measurement reports from said primitive 

17 metrics, 

1 2. The method of claim 1, said building step further 

2 comprising the step of: 

3 selecting as said metrics those which satisfy 

4 prioritized behaviors. 

1 3. The method of claim 2, said building step further 

2 comprising the step of: 

3 selecting as said metrics those which also satisfy 

4 related measures. 

1 4, A method for creating and using a measurement model 

2 work product, comprising the steps of: 

3 providing a target future business capabilities work 

4 product for defining customer goals necessary to 
END9 2000 0041 USl 39 



5 



achieve through measurements; and 



6 translating said customer goals into a measurement 

7 model work product defining account specific behaviors 

8 and measures that empirically demonstrate said 

9 behaviors. 

1 5* The method of claim 4^ further comprising the step of: 

2 defining a gap analysis work product specifying 

3 differences between said measurement model work product 

4 and current customer measurements to identify possible 

5 deficiencies in organization measurement processes. 

1 6, A system for creating and using a measurement model 

2 work product, comprising: 

3 a target future business capabilities work product for 

4 defining customer goals necessary to achieve through 

5 measurements; and 

6 a measurement model work product for translating said 

7 customer goals into account specific behaviors and 
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measures that empirically demonstrate said behaviors. 



1 7, The system of claim 6, further comprising: 

2 a gap analysis work product for specifying differences 

3 between said measurement model work product and current 

4 customer measurements to identify possible deficiencies 

5 in organization measurement processes • 

1 8, A method for defining the measures of performance of a 

2 customer information technology organization, comprising the 

3 steps of: 

4 collecting into a competency-defined measurement 

5 categories and measurements file definitions of 

6 selected categories of behavioral measurements; 

7 selecting from said file contract measurements; 

8 implementing said contract measurements; and 

9 using and maintaining said measurements. 
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1 9. The method of claim 8, said categories including human 

2 resources, quality, customer, cost and schedule, process, 

3 and productivity and output categories of behavioral 

4 measurements . 



1 10. System for formulating measurement requirements that 

2 are to be implemented in an engagement, comprising: 

3 a current customer measurements work product for 

4 detailing current measurements being collected and 

5 reported by a customer; 

6 a measurement model work product for translating 

7 customer goals into account specific behaviors and 

8 measures that empirically demonstrate said behaviors; 

9 and 

10 a measurement gap analysis work product for defining 

11 differences between said current measurements and said 

12 account specific behaviors and measures. 
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1 



11. The system of claim 10/ further comprising: 



2 an interface agreement work product for documenting 

3 expectations for data collection; 

4 a configuration script work product for configuring 

5 tools required to implement said requirements; 

6 a contract measurement business policy work product for 

7 defining expectations of behavior required to support 

8 said requirements; and 

9 a scorecard work product for visualizing said 
10 requirements, 

1 12. A measurement and performance management method, 

2 comprising the steps of: 

3 during a proposal contextual phase^ developing a 

4 measurement solution to be delivered to a customer; 

5 during a due diligence phase, validating assumptions 
5 and behavioral expectations in said measurement 

7 solution; and 
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8 during a transformation phase, transferring to said 

9 customer resources and assets for implementing said 
10 measurement solution as validated. 

1 13. The method of claim 12, said developing step comprising 

2 the further step of: 

3 building said measurement solution responsive to inputs 

4 from a measurement catalog work product and a target 

5 future business capabilities work product. 

1 14. The method of claim 13, said validating step comprising 

2 the further step of: 

3 executing a measurement gap analysis work product 

4 responsive to inputs from a current customer 

5 measurements work product, a future process design 

6 points work product, a to-be organization design work 

7 product and a to-be process design work product. 
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1 15. The method of claim 14^ said transferring step 

2 comprising the further step of: 



3 pursuant to an interface agreement work product, 

4 providing an external interface requirements work 

5 product, a configuration script work product, a 

6 contract measurement business policy work product, a 

7 scorecard work product, an end-user training materials 

8 work product, and a deployment plan work product. 

1 16. System for formulating measurement requirements that 

2 are to be implemented in an engagement, comprising; 

3 means operable during a proposal contextual phase for 

4 developing a measurement solution to be delivered to a 

5 customer; 

6 means operable during a due diligence phase for 

7 validating assumptions and behavioral expectations in 

8 said measurement solution; and 

9 means operable during a transformation phase for 

10 transferring to said customer resources and assets for 

11 implementing said measurement solution as validated. 
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1 17, Method for executing a gap analysis responsive to a 

2 measurement model and current customer measurements^ 

3 comprising the steps of: 

4 mapping said current measurement model to said current 

5 customer measurements and identifying measurement gaps; 

6 identifying measurements not covered by said 

7 measurement model; 

8 identifying nonproductive measurements; 

9 identifying the impact to an organizational structure 

10 and processes of said customer of said measurement 

11 gaps; and 

12 identifying any other requirements for measurement 

13 program success • 
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1 18. A canonical method for defining a measurements model 

2 work product^ comprising the steps of: 

3 articulating envisioned business goals and behaviors; 

4 eniimerating and defining behaviors and goals satisfied 

5 by said behaviors in a database of existing contract 

6 measurements; 

7 selecting potential measurements for said business 

8 goals and behaviors from said database; 

9 prioritizing and balancing said potential measurements 
10 to determine said measurement model work product, 

1 19. System for defining a measurements model work product, 

2 comprising: 

3 a first database for articulating envisioned business 

4 goals and behaviors; 

5 a second database for enumerating and defining 

6 behaviors and goals satisfied by said behaviors 

7 selected from existing contract measurements; 
END9 2000 0041 USl 47 



8 means for selecting potential measurements for said 

9 business goals and behaviors from said second database; 

10 prioritizing and balancing means for determining from 

11 said potential measurements those to be included in 

12 said measurement model work product, 

1 20* A method for defining a measurements model work 

2 product^ comprising the steps of: 

3 defining the goals of a customer information technology 

4 organization; 

5 defining behaviors associated with said goals; 

6 mapping said behaviors against a measurement catalog to 

7 identify first measures related to said behaviors; 

8 building a first draft measurement model from said 

9 first measures; 

10 prioritizing said first measures with respect to number 

11 of behaviors satisfied; 
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12 
13 



prioritizing said first measures with respect to nuinber 
of related measures; 



14 responsive to said prioritizing steps^ building a 

15 second draft measurement model » 

1 21. The method of 20^ further comprising the step of 

2 performing gap analysis on said measurement model. 

1 22. A program storage device readable by a machine, 

2 tangibly embodying a program of instructions executable by a 

3 machine to perform method steps for defining the measures of 

4 performance of a customer information technology 

5 organisation, said method steps comprising: 

6 identifying customer performance goals; 

7 building a model in response to the customer goals 

8 including a plurality of primitive metrics; 

9 performing gap analysis of the model to determine which 

10 of the primitive metrics are already collected by said 

11 organization and the process capabilities for data 
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collection; 



13 identifying new data collection sources for those 

14 primitive metrics which are not already collected by 

15 said organization; 

16 implementing tools and processes for gathering said 

17 primitive metrics; and 

18 generating measurement reports from said primitive 

19 metrics. 



1 23 • A program storage device readable by a machine, 

2 tangibly embodying a program of instructions executable by a 

3 machine to perform method steps for creating and using a 

4 measurement model work product said method steps 

5 comprising: 

6 providing a target future business capabilities work 

7 product for defining customer goals necessary to 

8 achieve through measurements; and 



9 
10 



translating said customer goals into a measurement 
model work product defining account specific behaviors 
END9 2000 0041 USl 50 
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12 



and measures that empirically demonstrate said 
behaviors . 



1 24. A program storage device readable by a machine ^ 

2 tangibly embodying a program of instructions executable by a 

3 machine to perform method steps for defining the measures of 

4 performance of a customer information technology 

5 organization, said method steps comprising: 

6 collecting into a competency-defined measurement 

7 categories and measurements file definitions of 

8 selected categories of behavioral measurements; 

9 selecting from said file contract measurements; 

10 implementing said contract measurements; and 

11 using and maintaining said measurements. 



1 25, A program storage device readable by a machine, 

2 tangibly embodying a program of instructions executable by a 

3 machine to perform method steps for providing a measurement 

4 and performance management method, said method steps 
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comprising: 



6 during a proposal contextual phase, developing a 

7 measurement solution to be delivered to a customer; 

8 during a due diligence phase, validating assumptions 

9 and behavioral expectations in said measurement 

10 solution; and 

11 during a transformation phase, transferring to said 

12 customer resources and assets for implementing said 

13 measurement solution as validated. 



1 2 6, A program storage device readable by a machine, 

2 tangibly embodying a program of instructions executable by a 

3 machine to perform method steps for executing a gap analysis 

4 responsive to a measurement model and current customer 

5 measurements, said method steps comprising: 

6 mapping said current measurement model to said current 

7 customer measurements and identifying measurement gaps; 



8 



9 



identifying measurements not covered by said 
measurement model; 
END9 2000 0041 USl 52 



10 



identifying nonproductive measurements; 



11 identifying the impact to an organizational structure 

12 and processes of said customer of said measurement 

13 gaps; and 

14 identifying any other requirements for measurement 

15 program success. 

1 27 • A program storage device readable by a machine, 

2 tangibly embodying a program of instructions executable by a 

3 machine to perform method steps for defining a measurements 

4 model work product, said method steps comprising: 

5 articulating envisioned business goals and behaviors; 

6 enumerating and defining behaviors and goals satisfied 

7 by said behaviors in a database of existing contract 

8 measurements; 

9 selecting potential measurements for said business 

10 goals and behaviors from said database; 

11 prioritizing and balancing said potential measurements 
END9 2000 0041 USl 53 
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to determine said measurement model work product* 



1 28. A program storage device readable by a machine, 

2 tangibly embodying a program of instructions executable by a 

3 machine to perform method steps for defining a measurements 

4 model work product, said method steps comprising: 

5 defining the goals of a customer information technology 

6 organization; 

7 defining behaviors associated with said goals; 

8 mapping said behaviors against a measurement catalog to 

9 identify first measures related to said behaviors; 

10 building a first draft measurement model from said 

11 first measures; 

12 prioritizing said first measures with respect to number 

13 of behaviors satisfied; 

14 prioritizing said first measures with respect to number 

15 of related measures; 
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15 

17 



responsive to said prioritizing steps, building a 
second draft measurement model. 



a 
m 
m 

m 

m 
m 

o 

m 
a 

w 
a 

a 



END9 2000 0041 USl 



SYSTEM AND METHOD FOR MEASURING AND MANAGING PERFORMANCE IN 
AN INFORMATION TECHNOLOGY ORGNIZATION 

Abstract of the Disclosure 

5 An IT measurement system is aligned with the IT 

organization's business goals by examining the IT 
organization*^ s current state-of-af fairs with respect to 
measurement and analyzing how it maps to a proposed 
measurement model. To ensure the viability of the proposed 

10 measurement model, the IT organization and measurement 

processes it employs are structured to naturally support the 
collection, analysis, reporting, and use of the measurements 
in the proposed model* The measurement model and associated 
techniques work from a top-down approach, starting with the 

15 goals of the organization, identifying appropriate behaviors 
and finally associating measures that will empirically 
demonstrate achievement of the behaviors* In addition, 
algorithms for prioritization are executed to ensure that 
the best fitting measures are selected in the final 

2 0 measurement model. 
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Att. Docket No. END9 2000 0041 USl 



DECLARATION AND POWER OF ATTORNEY FOR PATENT APPLICATION 

As a below named inventor, I hereby declare that: 

My residence, post office address and citizenship are as stated below next to my 
name; I believe I am the original, first and sole inventor (if only one name is 
listed below) or an original, first and joint inventor (if plural names are listed 
below) of the subject matter which is claimed and for which a patent is sought on 
the invention entitled: SYSTEM AND METHOD FOR MEASUMNG AND MANAGING 
PERFORMANCE IN AN INFORMATION TECHNOLOGY ORGANIZATION 

the specification of which (check one) 

X is attached hereto. 



was filed on as Application Serial No, or PCAT 

International Application No. and was amended on (if 

applicable) . 

I hereby state that I have reviewed and understand the contents of the 
above-identified specification, including the claims, as amended by any amendment 
referred to above. 

I acknowledge the duty to disclose information which is material to the 
patentability of this application in accordance with Title 37, Code of Federal 
Regulations, Section 1.56. 

I hereby claim foreign priority benefits imder Title 35, United States Code^ Section 
119 (a) -(d) or Section 365(b) of any foreign application (s) for patent or inventor's 
certificate or Section 365(a) of any PCT International application which designated 
at least one country other than the United States^ listed below and have also 
identified below any foreign application for patent or inventors certificate^ or 
PCAT International application having a filing date before that of the application 
on which priority is claimed: : 

Prior Foreign Appplication{s) : 

Number Coxintry Date/Month/Year Priority Claimed 



I hereby claim the benefit under 35 U.S*C. Section 119(e) of any United States 
provisional application (s) listed below. 

Application Niomber Filing Date 



I hereby claim the benefit under Title 35^. United States Code, section 120 of any 
United States application (s) , or Section 365(c) of any PCT International application 
designating the United States,, listed below and, insofar as the subject matter of 
each of the claims of this application is not disclosed in the prior United States 
or PCT International application in the manner provided by the first paragraph of 35 
U.S.C. Section 112, I acknowledge the duty to disclose information material to 
patentability of this application as defined in 37 CFR Section 1.56 which became 
available between the filing date of the prior application and the national or PCT 
International filing date of this application: 

Prior U.S. Applications; 

Serial No. Filing Date Status (patented, pending, abandoned) 
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As a named inventor, I hereby appoint the following attorneys and/or agents to 
prosecute this application and transact all business in the Patent and Trademark 
Office connected therewith: David L. Adour, Reg. No. 29,604; Lawrence R. Fraley, 
Reg. No. 26,885; John R* Pivnichny, Reg. No. 43,001; Arthur J. Samodovitz, Reg. No. 
31,297; William H. Steinberg, Reg. No. 28,540; Christopher A. Hughes, Reg. No. 
26,914; Edward A. Pennington, Reg, No. 32,588; John H. Hoel, Reg. No. 26,279; Joseph 
C. Redmond, Jr., Reg. No. 18,753; and Shelley M Beckstrand, Reg. No. 24,88 6. 



Send all correspondence to: 



Direct telephone calls to: 



Shelley M Beckstrand, P.C. 
Attorney at Law 
314 Main Street 
Owego, NY 13827 

(607) 687-9913 [alt: (607) 755-3268] 



I hereby declare that all statements made herein of my own knowledge are true and 
that all statements made on information and belief are believed to be true; and 
further that these statements were made with the knowledge that willful false 
statements and the like so made are punishable by fine or imprisonment, or both, 
under Section 1001 of Title 18 of the United States Code and that such willful false 
statements may jeopardize the validity of the application or any patent issued 
thereon. 



(1) 



Inventor: 
Signature: 



Residence: 

Citizenship: 

Post Office Address: 



SUZANNE M. JORDAN 



Date: 



6618 GARLINGHOUSE LANE, DALLAS TX 75252 
USA 

SAME AS RESIDENCE 



(2) 



Inventor : 
Signature : 



Residence : 

Citizenship: 

Post Office Address: 



PATRICK W, McMAHON 



Date: 



3621 MEADOW DRIVE, ERIE, PA 16506 
USA 

SAME AS RESIDENCE 



(3) 



Inventor : 
Signature: 



Residence: 

Citizenship: 

Post Office Address: 



DAVID B. MCNEILL 



Date: 



2412 SCOUTING TRAIL, RALIEGH, NC 27615 
USA 

SAME AS RESIDENCE 



(4) Inventor: NORA M. PANLILIO-YAP 

Signature: Date: 

Residence: 4045 FRAGILE SAIL mY, ELLICOTT CITY, MD 20142-5017 

Citizenship: CANADIAN 

Post Office Address: SAME AS RESIDENCE 
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